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Abstract — The communication for the control of distributed 
energy generation (DEG) in microgrid is discussed. Due to the 
requirement of realtime transmission, weak or no explicit channel 
coding is used for the message of system state. To protect the 
reliability of the uncoded or weakly encoded messages, the system 
dynamics are considered as a 'nature encoding' similar to convo- 
lution code, due to its redundancy in time. For systems with or 
without explicit channel coding, two decoding procedures based 
on Kalman filtering and Pearl's Belief Propagation, in a similar 
manner to Turbo processing in traditional data communication 
systems, are proposed. Numerical simulations have demonstrated 
the validity of the schemes, using a linear model of electric 
generator dynamic system. 



L Introduction 

In recent years, smart grid has attracted significant studies 
due to its capability of improving the efficiency and robustness 
of power grid [2|. An important component in smart grid is 
the microgrid H] @, which is a network containing multiple 
distributed energy generators (DEGs, like solar panels, micro- 
turbines or wind turbines) and multiple loads. A microgrid can 
either be connected to or be separated from the power grid. In 
normal situations, the microgrid is connected to the power grid 
and obtains energy according to its own energy generation. 
When the power grid experiences an emergency, e.g., a large 
area blackout, the microgrid can be disconnected from the 
power grid and work in an island mode. At this time, the power 
load within the microgrid will be supported by the DEGs. Such 
a microgrid has been implemented in many testbeds, e.g., the 
Electric Reliability Technology Solutions (CERTS) Microgrid 
supported by the US Department of Energy. 

An important aspect of the microgrid is the communication 
infrastructure for controlling the DEGs since they could be 
located at different places. In such a communication infrastruc- 
ture, the observations at sensors are sent to a processor (either 
centralized or decentralized) for system state monitoring or 
control. In traditional microgrids, wired communications are 
employed. For example, an RS-485 (digital computer based) 
link or an ethernet is used in the Oak Ridge National Lab 
(ORNL) microgrid system [SJ. An alternative approach for 
the communication for DEG control is to use wireless com- 
munication systems due to its fast deployment. In wireless 
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Fig. 1: An illustration of the communication procedure and 
dynamic system. 



medium, fading, noise and interference may cause damage to 
the received signal of messages for DEG control. Therefore, 
a channel coding scheme is needed to protect the messages. 
However, there is a stringent requirement on the delay of 
messages due to the dynamics of DEGs. Hence, it is impossi- 
ble to accumulate sufficiently many bits for a long codeword 
length and the corresponding coding gain since this will incur 
a substantial delay. Therefore, an effective approach is to use 
short codeword length which loses the protection on the bits 
in the message. 

In this paper, we study the decoding procedure (including 
the demodulation procedure) for the messages with no or weak 
channel coding protection in the context of DEG control in 
microgrid. The key point is to exploit the redundancy in the 
system state, which can be considered as a 'nature encoding ' 
for the messages. In this paper, a linear system model is 
adopted, where x(t + 1) = Ax(f) + Bu(t) + n{t) is used to 
describe the dynamics of system state x subject to the control 
u{t) and noise n(t). We observe that the system state is similar 
to the convolutional codes except that the 'encoding' of the 
system state is in the real field instead of the Galois field. 
Hence, the message actually has been channel coded by the 
nature although no explicit or little explicit channel coding 
is used at the transmitter We use both schemes of Kalman 
filtering and Pearl's Belief Propagation (BP) for the soft 
decoding, combined with the soft demodulation to improve the 
reliability of demodulation and decoding. A practical dynamic 
system for the DEGs will be used for numerical simulation, 
which demonstrates the performance gain of incorporating the 
inherent redundancy in the 'nature encoding'. The procedure 
is illustrated in Fig. [T| Note that such a scheme is similar 
to the Turbo processing techniques like Turbo decoding ||8J, 
Turbo multiuser detection [11 1 and Turbo equalization lfT2l 
in wireless communication systems. However, the 'nature 
encoding' is analog and implicit, thus resulting in a different 
processing procedure. 

The remainder of this paper is organized as follows. The 
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system model is introduced in Section The decoding 
procedure is discussed for the schemes of Kalman fihering 
based heuristic approach and the BP approach in Sections |III] 
and |IV] respectively. Numerical simulation results are shown 
in Section |V] Finally, the conclusions are drawn in Section 

m 

II. System Model 

A. Linear System 

We consider a discrete time linear dynamic system, whose 
system state evolution is given by 

x(t + 1) = Ax{t) + Bu{t) + n(t), 
y{t) = Cx(t) + w(t) 



(1) 



where x{t) is the A^-dimensional vector of system state at 
time slot t, u{t) is the M-dimensional control vector, y 
is the i(r-dimensional observation vector and n and w are 
noise vectors, which are assumed to be Gaussian distributed 
with zero expectation and covariance matrices S„ and S^, 
respectively. For simplicity, in this paper we do not consider 
nit). 

We assume that the observation vector y{t) is obtained 
by a sensoiQ. The sensor quantizes each dimension of the 
observation using B bits, thus forming a bit sequence which 
is given by 



hit) = {bi{t),b2{t),...,bKBit)). 



(2) 



B. 



Communication System 

Suppose that binary phase shift keying (BPSK) is used for 
the transmission from the sensor to the controller. The bit 
sequence is passed through an optional channel encoder, which 
generates an i-bit sequence s{t). Then, the received signal at 
the controller is given by 



r(t) -s(t) + e(i), 



(3) 



where the additive white Gaussian noise e{t) has a zero 
expectation and variance Ug. Note that we ignore the fading 
and normalize the transmit power to be 1 . The algorithm and 
conclusion in this paper can be easily extended to the case 
with different types of fading. 

III. Kalman Filtering based Heuristic Approach 

In this section, we adopt a heuristic approach, which is 
based on Kalman filtering, to exploit the redundancy in the 
system state. We first carry out the Kalman filtering and then 
apply the prediction to the soft demodulation. 

A. Kalman Filtering 

When the observations y{t) are sent to the controller 
perfectly, the controller can use the following Kalman filtering 
to predict the future system state, whose expectation is given 
by 



x(i + l|t) = Ax{t\t), 



It is easy to extend to the case of multiple sensors. 



(4) 



where 

x{t\t) = x(t|i - 1) + K{t) (y - Cx(t|i - 1)) 

and 



(5) 



(6) 



(7) 



(8) 



Kit) = - 1)C^ (^CS(t|t - 1) (C)^ + 
and the covariance matrix given by 

E(t|t) = S(t|i - 1) - KtCS(t|i - 1), 

where 

S(t + l|t) = AS(t|t)A'^ + Sp. 

B. Soft Decoding and Demodulation 

Based on the Kalman filtering, the controller can obtain the 
distribution of the observation, which is Gaussian distributed 
with the expectation x{t\t — 1) given by Eq. (|4| and the 
covariance S(t|i — 1) given by Eq. 

Because different dimensions in the observation yt are not 
independent, it is challenging to directly compute the a priori 
probability for each bit, which is given by (suppose that i is 
used to describe the i-th bit in b(<)) 

m - = l|y(-cx) : t)) 

1 



= j i{h{t) = iMt) = y) 



v/27r|S(t|t 

X exp(-i(y-x(t|i-l))^xS-i(i|t-l) 
X (y-x(i|<-l)))dy. 



(9) 



We propose to use the Monte Carlo simulation to obtain a 
series of samples of {yt } based on the prediction of Kalman 
filtering, then quantize these samples to obtain a series of 
samples bt_i and calculate the prior probability for bj. 
We use as the a priori probability of being 1 for 

demodulating h(t). Then, the a posteriori probability of hi{t) 
is given by 



P{h{t) = l|r(-oo : t)) 

P{r{t)\h{t) = l)Ut) 

P{v{t)\h{t) = W + P{r{t)\h{t) = 0)(1 - Ut)] 

{n{t)-i)^ 



where 

P{y{t)Ut)^l) 



1 



: exp 



P(.y{t)\h{t)^Q)^^L=c^j> 



{n{t) + l)^ 

2a1 



(11) 
(12) 



Note that the Kalman filtering is no longer rigorous in the 
networked control system due to the quantization error and 
possible decoding error. The proposed heuristic approach is 
based on the assumption that the Kalman filtering is very 
precise. As will be shown in the numerical results, this 
approach will be seriously affected by the propagation of 
decoding errors. 
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Fig. 2: An illustration of the coding structure. 
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Fig. 3: Message Passing of BP. 



IV. BP BASED Iterative Decoding 

In this section, we consider the iterative decoding using BP 
with the mechanism of message passing between the system 
state and received signals. The key observation is that the 
entire information passing is similar to a concatenated coding 
structure, as illustrated in Fig. |2l The outer coding is carried 
out by the dynamic system, where the system state x is 
encoded similarly to a convolutional code and the observation 
y is linearly encoded by the observation matrix C and the 
system state x. The inner code is the explicit encoding of 
the observation vector. Hence, we can adopt the iterative 
decoding approach in Turbo codes or LDPC codes Q. In a 
sharp contrast, the proposed Kalman filtering based heuristic 
approach has only one round. 

ifTOl has shown that many iterative decoding algorithm, 
such as Turbo decoding can be considered as the application 
of Pearl's BP algorithm [9J. In this section, we first illustrate 
the principle through an example and then explain how to 
apply Pearl's BP into our dynamic state system. 

A. Introduction of Pearl's BP 

As shown in Fig. [3] random variable X has parents 
Ui,U2, - ■ ■ ,Um and children Yi, I2, • " ' : ^/v- The message 
passing of Pearl's BP is indicated by green arrows and red 
arrows in the figure. Green arrows transmit 7r-message which 
is sent from parent to its children. For instance, the message 



passing from to X is 'Ku^,x{Um), which is the prior 
information of [/,„ conditioned on all the information 
has received. Red arrows transmit A-message which is from 
children to its parent. For instance, the message passing from 
Yn to X is Xy„.x{X), which is the likelihood of X based 
on the information y„ has received. After X receives all ir- 
message tt^/^ {U,n ) from its parents Ui,U2, - ■ ■ ,Um and all 
A-message Xy„.x{X), X from its children Yi,Y2,--- ,Yn, 
X updates its belief information BELx{^) and transmits A- 
messages \x.Um{Um) to its parents and 7r-message Trx,Y„{^) 
to its children. The expressions of the quantities are given by 



TTjf (x) 

7x(U) 
BELxix.) 

7rx,y„ (x) 



E 

u 



(x|U) II nu^,xiU„,) (13) 



N 



(14) 



1=1 

N 

[] Ay„,x(x) x^x(x) (15) 



X n—1 
N 



E ^^(U) X H TTu^.xiU,) (16) 
7rx(x) X []Ay.,x(x) (17) 

where U = ([/i, C/2, • ■ • , Um) and Y = (Fi, 1^2, • ■ • , Un) 

In the initialization procedure of Pearl's BP, some initial 
values are needed for the running of Pearl's BP. The initial 
values are defined as 



Ajf,(7(u) 

and 

7rjc,y(x) : 



p(xo|u), Xis evidence, X = Xq 



1, 



Xis not evidence 



,(18) 



(5(x, Xo), Xis evidence, x = Xq 



X is source, not evidence 



(19) 



B. Application of Pearl's BP in Microgrid 

The Bayesian network structure of the control system and 
communication system in the DBG networked control in mi- 
crogrid is shown for three time slots in Fig.|4] In the Bayesian 
network, the system state is dependent on the previous system 
state and the control action; the observation is dependent 
on the system state; the uncoded bits are dependent on the 
observation vector; the received signal is dependent on the 
uncoded bits. Here we omit the coded bits as the relationship 
between the uncoded bits and the coded bits is deterministic. 
Fig. m shows the Bayesian Network structure for the dynamic 
system with three observations: Xt_2, Xt_i and Xj. 

Based on the Bayesian network structure, the iterative 
decoding procedure can be derived. Fig |4] shows the message 
passing in the dynamic system. X4_2 summarizes all the 
information obtained from previous time slots and transmits 
TT-message 7rx(_2,xt-i (xt-2) to Xt_i. The BP procedure can 
be implemented in synchronous or asynchronous manners. As 
the decoding process has a large overhead, we implement 
asynchronous Pearl's BP. The updating order and message 
passing in one iteration is as follows: step 1): xt_i ^ Yt-i, 
step 2): yt-i ^ ht i, step 3): ht i ^ yt-i\ step 4): yt-i ^ 
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Fig. 4: Bayesian network structure and message passing for 
the dynamic system. 



xt_i; step 5): xt_i ^ x*; step 6): x* ^ y*; step 7): ^ bt; 

step 8): bt ^ yt; step 9): y* ^ x*; step 10): Xt ^ xt_i; step pj 5. y^^^^ Square Error comparison for system without 

11): xt-i updates information. The mathematical derivation channel coding 
for each step is provided in Appendix |A] Due to the limited 
space, we provide only the most challenging steps. The full 

derivation will be given in our journal version. i»° e ^ 



V. Numerical Simulations 

In this section, we use numerical simulations to demonstrate 
the algorithms proposed in this paper. 

A. Dynamic System Model 

We consider a dynamic system of DEG in which the system 
state is a 7-dimensional vector. The system is in the continuous 
time. The system dynamics is described by a differential 
equation x(t) — A'x(t), where the matrix A' is given by (|20] | 
(Example 12.9 in |4|). The physical meanings of the system 
states are given in Table U For simplicity, we assume that the 
system is unregulated, i.e., B = 0, and the sensor can sense 
the system state directly, i.e., C = I. We approximate the 
continuous time system using the discrete time system with 
a small step size 5t. Therefore, the matrix A in the discrete 
time system is given by A = I + 5tA'. 

TABLE I: Physical Meaning of System States 



Xl,X2 


rotor swings 




excitation circuit 


X4 


damping circuit in the d-axis and excitation circuit 


2^5 


damping circuit in the q-axis 


X6 


voltage controller and excitation circuit 


X7 


voltage controller 



We run the simulations using Matlab to compare the perfor- 
mances of Kalman filtering and Pearl's BP based algorithms 
for systems with and without channel coding. The baseline 
approach is the separated Kalman filtering and decoding 
process. In the following, these three algorithms are referred 
as 'KF with Prior', 'Pearl BP' and 'KF', respectively. The 
performance metrics are the mean square error (MSE) of each 
sample and the average bit error rate (BER). Each simulation 
runs 1000 times slots. The configuration for both systems are 
as follows: for the dynamic system of DEG described in ([T]l: 
5t = 0.01, Sp = 0.05, So = 0.05. Each dimension of the 
observation yt is quantized with 16 bits, and the dynamic 
range for quantization is [—200,200]. A 1/2 rate Recursive 




Fig. 6: Bit Error Rate comparison for system without channel 
coding 



Systematic Convolutional (RSC) code is used as the channel 
coding scheme; and the code generator is g — [1,1,1]. The 
decoding algorithm is Log-Map algorithm. 



B. Uncoded Case 

Figures |5] and |6] show the simulation results for the uncoded 
case with different When > 5, the performance of 
'Pearl BP' is much better than 'KF' and 'KF with Prior'; 
when ^ > 7, the performance of 'KF with Prior' is better 
than 'KF' . This demonstrates that the redundancy in the system 
state can improve the performance when ^ is high. Compared 
with 'KF with Prior', the performance gain of 'Pearl BP' stems 
from the utilization of soft decoding output in the system state 
estimation. However, in the low regime, the performances 
of 'Pearl BP' and 'KF with Prior' are worse than 'KF'. This is 
because the cascading effect of the decoding error and system 
sate estimation error. The worst case is that some highest bits 
of observations are not decoded correctly, then the estimated 
observation largely deviates from the correct value; and then 
this error will propagate to succeeding time slots and thus will 
lead to the collapse of 'KF with Prior' or 'Pearl BP' algorithm. 
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Fig. 7: Mean Square Error comparison for system with channel Fig. 8: Bit Error Rate comparison for system with channel 
coding coding 



C. Coded Case 

Figures |7] and [U show the simulation resuhs for the channel 
coded case with different As shown in the figures, the 
performance of 'Pearl BP' is always the best except that the 
bit error rate is worse than 'KF with Prior' occasionally. In 
a contrast to the 'Pearl BP' for the uncoded case, 'Pearl BP' 
does not collapse for coded case due to the gain of channel 
coding. When ^ > 3, the performance of 'KF with Prior' is 
better than that of 'KF'. These results demonstrate that using 
the redundancy in system state can improve performance in the 
coded case. The performance gain of 'Pearl BP' over 'Kalman 
Filter with Prior' in low ^ shows the gain of using soft 
decoding output in state estimation. When ^ > 5, these three 
algorithms have good performance which is due to the gain 
of channel coding. 

VI. Conclusions 

In this paper, we have proposed to use Kalman Filter 
based and Pearl's BP based decoding procedure (including 
the demodulation procedure) to exploit the redundancy, i.e., 
the nature encoding in the system state for the system with 
no or weak channel coding protection in the context of DEG 
control in microgrid. The numerical simulation results have 
shown that, when ^ is high, the proposed algorithms achieve 
significant performance gain, compared with traditional sep- 
arated decoding and system state estimation. However, when 
is low, the proposed algorithms may incur performance 
degradation due to the error propagation. This motivates us to 
study the mechanism to prevent such an adversarial effect. 



Appendix A 
Derivation of Key Steps in the Pearl's BP 

In the following derivation part, we will use the following 
two basic equations, where M{x, /i, a is the probability density 
function of Gaussian distribution with expectation /i and 
variance a at x: 

/oo 
A/'(x, mi,Si)A/'(y,Cx,S2)dx 
-OO 

cx A/'(y,Cmi,CSiC^ + S2), (21) 

and 

AA(x,mi,Si)AA(x,m2,S2) « A/'(x,m3,S3), (22) 
where the variance is given by 

S3-(Er^ + S2-i)-\ (23) 
and the expectation is given by 

m3 = S3(S^imi + S^im2). (24) 



6 



Below is the notation used throughout the derivation: 

7rxt_i,Xt(Xt-l) = M{Xt-l,^7T^,t-l,P7T^,t-l) 

7rx«_i,yt_i(Xt-l) = N'{Xt-l,X7ry,t-l,P^y,t-l) 

7ryj,bt(yt) = A/'(yt,y^,t,S'^,t) 

7rxt(xt) = N{y.t,^i,t,PLt) 

'ryt(yt) = A/'(yt,yi,t,5i,t) 

'^yt.xtCxt) = N{yiuyi\y,uP\y,t) 

Ax(,xt_i(xt-l) = Ar(X(_i,XA,,t-l,PA,,t-l) 

•^bt,yt(yt) = A/'(yt,yA,t,5'A,t) 

BEL(xt) = A/'(Xi,XBELJ,ftEL,<) 

p(xt|xt_i) = A/'(xi,^xt_i +Sut_i,Sp). 
1) Step 1: Xt_i yt-i: we have 
7rx,_i(a;t-i) 

P(xt-1 |Xt_2)7rxt_2,Xt_i (Xt_2)rfxt_2 

= Ar(xt_i,Xi,t_i,P,,t_i), (25) 

where the expectation is given by 

x;,t-i = Ax^^,t_2, (26) 
and the variance is given by 



- f 

J — t 



The behef is thus given by 

BELxt_i = a X 1 X A(y(_i,xt_i)(xt_i) 
X 7rx,_i(x(_i) 

= ^^(xt.ijXBEM-l.-PBEL,*-!), (34) 

where the variance is given by 

-FbEL,t-i = {P\^,t-i+ Pht-\)~^^ (35) 
and the expectation is given by 

XBEL,t-l = -PbEL,*-! X {Px^^t-l ^ ''^Aj,,*-! 

+ P;7/_i X Xi,t_l). (36) 

4) Step 10: x^ X(_i, we have 

Axt,X(_i(Xt-l) = 7x,(Xt-l) 

/OO 
Kt ,xt (xt )p(xt _ 1 |yt- 1 )rfxt 
-CJO 

= Ar(xt_i,XA,,t-i,PA.,t-i), (37) 
where the variance is given by 



1\T 



XA«,t-l 



= A ixA„t. 
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xt_i,yt_i (xt-i) 

where 

X,r„,t-1 
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